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Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the application: 

Listing of Claims: 

1-25. (Canceled) 

26. (Currently Amended) The system of claim [[28]] 75 wherein said timing 
data comprises one of timestamp information, timecode information, frame numbering 
information and global time of day. 

27. (Canceled) 

28. (Currently Amended) A hyperlinked reception system comprising: 

a receiver in communication with a broadcast channel , the receiver decoding a digital 
broadcast signal transmitted over the broadcast channel to recover a video signal, a plurality of 
masks, and a plurality of object data packets included in the broadcast signal, each mask 
corresponding to a particular video frame of a video program and including graphics data 
associated with one or more video objects in the particular video frame, each mask including an 
identifier to an object mapping table included in at least a particular one of the plurality of object 
data packets, the object mapping table including an entry associated with each of the one or more 
video objects in the particular video frame, each entry in the object mapping table referencing 
one or more information data structures included in one or more of the plurality of object data 
packets, the information data structures including information associated with the corresponding 
video object ; and 

a display device in communication with said receiver, the display device overlaying one 
or more graphics images on a particular video frame based on the graphics data in the mask for 
the particular video frame, and 
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a processor coupled to the receiver, the processor being configured to: 

receive a user selection associated with one of the graphics images overlaid on the 
particular video frame; 

retrieve the identifier of the object mapping table from the mask corresponding to 
the particular video frame responsive to the user selection; 

retrieve the object mapping table based on the retrieved identifier; 

locate the entry in the object mapping table for the video object associated with 
the one of the graphics images; 

identify the one or more information data structures referenced in the located 

entry; 

retrieve information in the identified one or more information data structures; and 
display the retrieved information on the display device. 

whoroin said rec e iv e r decodes a digital broadcast signal to recov e r a video signal, mask 
data, and annotation data includ e d in the broadcast signal, th e mask data including graphics data 
for each of a plurality of vid e o fram e s of th e video signal and th e annotation data including 
information on a video object app e aring on e ach of the plurality of vid e o frames, wh e r e in at l e ast 
th e mask data is compressed based on a compression algorithm; 

wherein, in r e spons e to a view e r r e quest, said display d e vice draws a graphics imag e on a 
fram e by fram e basis bas e d on th e graphics data for the corr e sponding video fram e , the drawing 
of th e graphics imag e b e ing synchroniz e d to th e corr e sponding vid e o fram e bas e d on timing data 
associated with th e graphics data. 

29-32. (Canceled) 

33. (Currently Amended) The system of claim 28, wherein said annotation data 
compris e s information data structures include information regarding goods and services for sale. 
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34. (Currently Amended) The system of claim 28, wherein said annotation data 
comprises information data structures include non-commercial information. 

35. (Currently Amended) The system of claim 28 wherein said annotation data 
further information data structures include[[s]] at least one of textual data and graphics data. 

36. (Currently Amended) The system of claim 35 wherein said mask data each of the 
masks includes location information of the one or more video objects in the corresponding video 
frame. 

37. (Currently Amended) The system of claim 36 wherein said location information 
includes a graphics location reference that represents a fixed relation to a set of pixels associated 
with said one or more video objects. 

38. (Previously Presented) The system of claim 37 wherein said graphics 
location reference includes an upper left most pixel in said associated pixel set. 

39. (Previously Presented) The system of claim 37 wherein said graphics 
location reference includes a centroid pixel of said associated pixel set. 

40. (Currently Amended) The system of claim 35 wherein [[said]] each of the 
masks data compri se s include location and shape information of the one or more video objects in 
the corresponding video frame. 

41. (Currently Amended) The system of claim 40 wherein said shape information is 
represented by the overlaid one or more graphics images a graphical ov e rlay of said one or more 
video objects. 
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42. (Currently Amended) The system of claim 40 wherein said shape information is 
represented by an outline of said one or more video objects. 

43. (Currently Amended) The system of claim 40 wherein said shape information is 
represented by a mathematical representation, of a set of pixels associated with said one or more 
video objects. 

44-48. (Canceled) 

49. (Currently Amended) The system of claim 28, further comprising: 

means for transmitting information related to [[said]] a viewer request of the one or more 
information data structures to a remote location over a backchannel communications channel. 

50. (Previously Presented) The system of claim 28, further comprising: 
means for accepting from a viewer information regarding a commercial transaction, and 

completing said transaction. 

51. (Previously Presented) The system of claim 50, wherein the information 
regarding a commercial transaction accepted from a viewer comprises at least one of a viewer's 
identifier, a viewers address, an identifier of a viewer's financial account, a viewer's password, a 
viewer's personal identification number, a quantity, a model, a size, a color, a descriptor of a 
good or service to be vended, and a price. 

52. (Currently Amended) The system of claim 28, wherein two or more of the 
plurality of object data packets have annotation data includ e s a plurality of annotations having 
equal timing information, and the processor processes a viewer request includ e s including an 
indication as to which annotation of the two or more of the plurality of object data packets 
annotation s is to be display e d processed for displaying information contained therein . 
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53-63. (Canceled) 

64. (Currently Amended) A hyperlinked broadcast system comprising: 

a video source providing a video program having a plurality of video frames ; 

a video encoder in communication with said video source, said video encoder producing 
a transport stream for transporting the video program ; 

an authoring tool providing mask data and object data for the video program mask and 
annotation data, th e mask data including graphics data for e ach of a plurality of vid e o frames 
provid e d by th e vid e o sourc e and th e annotation data including information on a video obj e ct 
app e aring on e ach of the plurality of video frames, wh e rein at l e ast th e mask data is compress e d 
based on a compr e ssion algorithm ; 

a data packet stream generator in communication with said authoring tool and said video 
encoder, said data packet stream generator producing encoded data packets including a plurality 
of masks and a plurality of object data packets, each mask corresponding to a particular video 
frame of the video program and including graphics data associated with one or more video 
objects in the particular video frame, each mask including an identifier to an object mapping 
table included in at least a particular one of the plurality of object data packets, the object 
mapping table including an entry associated with each of the one or more video objects in the 
particular video frame, each entry in the object mapping table referencing one or more 
information data structures included in one or more of the plurality of object data packets, the 
information data structures including information associated with the corresponding video 
object ; [[and]] 

a multiplexer system in communication with said video encoder and said data packet 
stream generator, said multiplexer generating a digital broadcast signal comprising an augmented 
transport stream from said transport stream and said encoded data packets[[,]] ; and 

means for transmitting the digital broadcast signal to a receiver. 
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wh e r e in said video e ncoder provid e s timing information for each of th e plurality of vid e o 
fram e s provid e d by th e vid e o sourc e to said data packet stream g e nerator, and said data pack e t 
stream generator stops through the plurality of vid e o frames and associates th e timing 
information of e ach vid e o fram e to th e graphics data, 

wh e r e in, a r e ceiv e r receiving the plurality of vid e o fram e s and th e graphics data 
synchronizes drawing of th e graphics image bas e d on th e graphics data, to an underlying fram e , 
bas e d on the timing information. 

65. (Currently Amended) The system of claim [[64]] 77 wherein said timing 
information comprises one of timestamp information, timecode information, frame numbering 
information and global time of day. 

66. (Currently Amended) The system of claim 64 wherein said information data 
structures include annotation data further compris e s at least one of textual data and graphics data. 

67. (Currently Amended) The system of claim 64 wherein each of the masks said 
mask data includes location information of the one or more video objects in the corresponding 
video frame. 

68. (Currently Amended) The system of 67 wherein said location information 
includes a graphics location reference that represents a fixed relation to a set of pixels associated 
with said one or more video objects. 

69. (Previously Presented) The system of claim 68 wherein said graphics 
location reference includes an upper left most pixel in said associated pixel set. 

70. (Previously Presented) The system of claim 68 wherein said graphics 
location reference includes a centroid pixel of said associated pixel set. 
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71. (Currently Amended) The system of claim 64 wherein [[said]] each of the masks 
include data comprises location and shape information of the one or more video objects in the 
corresponding video frame. 

72. (Currently Amended) The system of claim 71 wherein said shape information is 
represented by the overlaid one or more graphics images a graphical ov e rlay of said one or more 
video objects. 

73. (Currently Amended) The system of claim 71 wherein said shape information is 
represented by an outline of said one or more video objects. 

74. (Currently Amended) The system of claim 71 wherein said shape information is 
represented by a mathematical representation of a set pixels associated with said one or more 
video objects. 

75. (New) The reception system of claim 1, wherein the mask further includes timing 
data, and the display device draws the one or more graphics images on a frame-by-frame basis 
based on the graphics data in the mask for the corresponding video frame, the drawing of the one 
or more graphics images being synchronized to the corresponding video frame based on the 
timing data in the corresponding mask. 

76. (New) The reception system of claim 1, wherein each of the plurality of masks is 
compressed based on a compression algorithm. 

77. (New) The broadcast system of claim 64, wherein said video encoder provides 
timing information for each of the plurality of video frames of the video program provided by the 
video source to said data packet stream generator, and said data packet stream generator steps 
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through the plurality of video frames and associates the timing information of each video frame 
to a corresponding mask. 

78. (New) The broadcast system of claim 64, wherein each of the plurality of masks 
is compressed based on a compression algorithm. 

79. (New) The broadcast system of claim 64, wherein the receiver is configured to: 
decode the digital broadcast signal to recover the plurality of masks and the plurality of 

object data packets; 

overlay one or more graphics images on a particular video frame based on the graphics 
data in the mask for the particular video frame; 

receive a user selection associated with one of the graphics images overlaid on the 
particular video frame; 

retrieve the identifier of the object mapping table from the mask corresponding to the 
particular video frame responsive to the user selection; 

retrieve the object mapping table based on the retrieved identifier; 

locate the entry in the object mapping table for the video object associated with the one of 
the graphics images; 

identify the one or more information data structures referenced in the located entry; 
retrieve information in the identified one or more information data structures; and 
display the retrieved information on a display device. 

80. (New) The broadcast system of claim 79, wherein the mask further includes 
timing data, and the display device draws the one or more graphics images on a frame-by-frame 
basis based on the graphics data in the mask for the corresponding video frame, the drawing of 
the one or more graphics images being synchronized to the corresponding video frame based on 
the timing data in the corresponding mask. 
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8 1 . (New) A hyperlinked reception method comprising: 

decoding a digital broadcast signal transmitted over the broadcast channel to recover a 
video signal, a plurality of masks, and a plurality of object data packets included in the broadcast 
signal, each mask corresponding to a particular video frame of a video program and including 
graphics data associated with one or more video objects in the particular video frame, each mask 
including an identifier to an object mapping table included in at least a particular one of the 
plurality of object data packets, the object mapping table including an entry associated with each 
of the one or more video objects in the particular video frame, each entry in the object mapping 
table referencing one or more information data structures included in one or more of the plurality 
of object data packets, the information data structures including information associated with the 
corresponding video object; 

overlaying one or more graphics images on a particular video frame based on the 
graphics data in the mask for the particular video frame; 

receiving a user selection associated with one of the graphics images overlaid on the 
particular video frame; 

retrieving the identifier of the object mapping table from the mask corresponding to the 
particular video frame responsive to the user selection; 

retrieving the object mapping table based on the retrieved identifier; 

locating the entry in the object mapping table for the video object associated with the one 
of the graphics images; 

identifying the one or more information data structures referenced in the located entry; 

retrieving information in the identified one or more information data structures; and 

displaying the retrieved information on a display device. 

82. (New) The method of claim 81, wherein the mask further includes timing data, 
the method further comprising: 

drawing the one or more graphics images on a frame-by-frame basis based on the 
graphics data in the mask for the corresponding video frame, the drawing of the one or more 
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graphics images being synchronized to the corresponding video frame based on the timing data 
in the corresponding mask. 

83. (New) The method of claim 81, wherein each of the plurality of masks is 
compressed based on a compression algorithm. 

84. (New) A hyperlinked broadcast method comprising: 
providing a video program having a plurality of video frames; 
generating a transport stream for transporting the video program; 
generating mask data and annotation data for the video program; 

generating encoded data packets including a plurality of masks and a plurality of object 
data packets, each mask corresponding to a particular video frame of the video program and 
including graphics data associated with one or more video objects in the particular video frame, 
each mask including an identifier to an object mapping table included in at least a particular one 
of the plurality of object data packets, the object mapping table including an entry associated 
with each of the one or more video objects in the particular video frame, each entry in the object 
mapping table referencing one or more information data structures included in one or more of the 
plurality of object data packets, the information data structures including information associated 
with the corresponding video object; 

generating a digital broadcast signal comprising an augmented transport stream from said 
transport stream and said encoded data packets; and 

transmitting the digital broadcast signal to a receiver. 

85. (New) The method of claim 84 further comprising: 

providing timing information for each of the plurality of video frames of the video 
program; and 

stepping through the plurality of video frames and associating the timing information of 
each video frame to a corresponding mask. 
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86. (New) The method of claim 84 further comprising: 

compressing each of the plurality of masks based on a compression algorithm. 

87. (New) A hyperlinked reception system comprising: 

a receiver receiving over one or more television broadcast signals a plurality of object 
data packets and a video program having a plurality of video frames, the object data packets 
including one or more object mapping tables including an entry associated with each of one or 
more video objects in a particular video frame, each entry in the object mapping table 
referencing one or more information data structures included in one or more of the plurality of 
object data packets, the information data structures including information associated with the 
corresponding video object; and 

a display device in communication with said receiver, the display device overlaying one 
or more graphics images on a particular video frame based on associated mask data, the mask 
data including an identifier to a corresponding one of the one or more object mapping tables; and 
a processor coupled to the receiver, the processor being configured to: 

receive a user selection associated with one of the graphics images overlaid on the 
particular video frame; 

retrieve the identifier of the object mapping table from the mask data 
corresponding to the user selection; 

retrieve the object mapping table based on the retrieved identifier; 

locate the entry in the object mapping table for the video object associated with 
the one of the graphics images; 

identify the one or more information data structures referenced in the located 

entry; 

retrieve information in the identified one or more information data structures; and 
display the retrieved information on the display device. 
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